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Abstract 

Recently,  a  number  of  graph  partitioning  applications  have  emerged  with  additional  requirements 
that  the  traditional  graph  partitioning  model  alone  cannot  effectively  handle.  One  such  class  of  problems 
is  those  in  which  multiple  objectives,  each  of  which  can  be  modeled  as  a  sum  of  weights  of  the  edges  of  a 
graph,  must  be  simultaneously  optimized.  This  class  of  problems  can  be  solved  utilizing  a  multi-objective 
graph  partitioning  algorithm.  We  present  a  new  formulation  of  the  multi-objective  graph  partitioning 
problem  and  describe  an  algorithm  that  computes  partitionings  with  respect  to  this  formulation.  We 
explain  how  this  algorithm  provides  the  user  with  a  fine-tuned  control  of  the  tradeoffs  among  the  objec¬ 
tives,  results  in  predictable  partitionings,  and  is  able  to  handle  both  similar  and  dissimilar  objectives. 
We  show  that  this  algorithm  is  better  able  to  find  a  good  tradeoff  among  the  objectives  than  partitioning 
with  respect  to  a  single  objective  only.  Finally,  we  show  that  by  modifying  the  input  preference  vector, 
the  multi-objective  graph  partitioning  algorithm  is  able  to  gracefully  tradeoff  decreases  in  one  objective 
for  increases  in  the  others. 


1  Introduction 

Graph  partitioning  is  an  important  problem  with  extensive  application  to  many  areas.  The  graph  partitioning 
problem  is  defined  as  follow:  Given  a  graph  G  =  ( V ,  E)  in  which  V  is  a  set  of  vertices  and  E  is  a  set  of  edges, 
partition  V  into  k  subsets,  V\,  V2,  . . . ,  VR  such  that  R  p|  Vj  =  0  for  i  /  j ,  (J(.  R  =  V,  |V|  =  n/k ,  and  the 
number  of  edges  of  E  whose  incident  vertices  belong  to  different  subsets  is  minimized  (referred  to  as  the  edge- 
cut).  Some  examples  of  the  applications  for  this  problem  are  the  parallelization  of  numerical  simulations, 
computation  of  fill-reducing  orderings  of  sparse  matrices,  the  efficient  fragmentation  of  databases,  and  the 
partitioning  of  VLSI  circuits.  The  key  characteristic  of  these  applications  is  that  they  require  the  satisfaction 
of  a  single  balance  constraint  along  with  the  optimization  of  a  single  objective  (i.  e.,  the  edge-cut). 
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DAAH04-95-2-0003/contract  number  DAAH04-95-C-0008,  the  content  of  which  does  not  necessarily  reflect  the  position  or 
the  policy  of  the  government,  and  no  official  endorsement  should  be  inferred.  Additional  support  was  provided  by  the  IBM 
Partnership  Award,  and  by  the  IBM  SUR  equipment  grant.  Access  to  computing  facilities  was  provided  by  AHPCRC,  Minnesota 
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A  limitation  of  the  graph  partitioning  formulation  is  that  it  is  only  able  to  effectively  model  problems 
in  which  there  is  a  single  optimization  objective.  Recently,  a  number  of  applications  have  emerged  with 
additional  requirements  that  the  graph  partitioning  formulation  alone  cannot  effectively  handle.  In  many 
emerging  applications  there  is  a  need  to  produce  partitionings  that  attempt  to  optimize  multiple  objectives 
simultaneously.  For  example,  a  number  of  preconditioners  have  been  developed  that  are  focused  on  the 
subdomains  assigned  to  each  processor  and  ignore  any  intra-subdomain  interactions  (eg.,  block  diagonal  pre¬ 
conditioners  and  local  ILU  preconditioners).  In  these  preconditioners,  a  block  diagonal  matrix  is  constructed 
by  ignoring  any  intra-domain  interactions,  a  preconditioner  of  each  block  is  constructed  independently,  and 
then  they  are  used  to  precondition  the  global  linear  system.  The  use  of  a  graph  partitioning  algorithm 
to  obtain  the  initial  domain  decomposition  ensures  that  the  number  of  non-zeros  that  are  ignored  in  the 
preconditioning  matrix  is  relatively  small.  However,  the  traditional  partitioning  problem  does  not  allow  us 
to  control  both  the  number  as  well  as  the  magnitude  of  these  ignored  non-zeros.  A  partial  solution  to  this 
problem  can  be  obtained  by  assigning  weights  on  the  edges  according  to  the  magnitude  of  the  corresponding 
non-zeros.  Now,  using  traditional  graph  partitioning  algorithms,  we  will  obtain  a  decomposition  that  min¬ 
imizes  the  sum  of  the  magnitude  of  the  non-zero  entries  that  are  ignored  by  the  preconditioner.  However, 
such  an  approach  does  not  minimize  the  communication  overhead  incurred  by  parallel  processing.  This  is 
because,  this  approach  will  prefer  to  put  together  vertices  whose  corresponding  matrix  value  is  large,  at 
the  expense  of  potentially  cutting  a  large  number  of  edges  with  small  values.  However,  the  communication 
overhead  depends  on  the  overall  cut,  and  not  on  the  magnitude  of  the  corresponding  edges.  Ideally,  we  would 
like  to  obtain  a  decomposition  that  minimizes  both  the  number  of  intra-domain  interactions  (reducing  the 
communication  overhead)  and  the  numerical  magnitude  of  these  interactions  (potentially  leading  to  a  better 
preconditioner). 

Another  example  is  the  problem  of  minimizing  the  overall  communications  of  parallel  multi-phase  compu¬ 
tations.  Multi-phase  computations  consist  of  m  distinct  computational  phases,  each  separated  by  an  explicit 
synchronization  step.  In  general,  the  amount  of  interaction  required  between  the  elements  of  the  mesh  is 
different  for  each  phase.  Therefore,  it  is  necessary  to  take  the  communications  requirements  of  each  phase 
into  account  in  order  to  be  able  to  accurately  minimize  the  overall  communications. 

A  third  example  is  from  the  VLSI  domain.  Here  we  would  often  like  to  partition  circuits  so  that  multiple 
objectives  are  optimized.  For  example,  we  might  want  to  simultaneously  minimize  the  number  of  wires  that 
are  cut  by  the  partitioning  as  well  as  the  timing  characteristics  of  the  partitioned  circuit.  In  the  traditional 
problem,  we  only  attempt  to  minimize  the  number  of  edges  that  are  cut  by  the  partitioning.  This  will 
minimize  the  number  of  wires  that  need  to  be  run  between  circuits  on  different  chips.  However,  it  will 
not  necessarily  minimize  the  timing  characteristics  of  the  partitioned  circuit.  Since  the  propagation  delay 
between  chips  is  much  higher  than  the  propagation  delay  within  a  chip,  it  is  usually  unfavorable  to  cut  wires 
on  the  critical  path  of  the  circuit.  We  would  like  a  partitioning  algorithm  that  is  able  to  minimize  both  the 
number  of  wires  cut  by  the  partitioning  and  selected  timing  characteristics  of  the  circuit. 

All  of  the  above  problems  can  be  solved  by  modeling  them  as  graphs  in  which  every  edge  has  an  associated 
weight  vector  we  of  size  m,  every  vertex  has  a  scalar  weight,  and  for  which  we  find  a  partitioning  such  that 
each  subdomain  lias  a  roughly  equal  amount  of  vertex  weight  and  the  edge-cut  with  respect  to  each  of 
the  m  weights  is  optimized.  Karypis  and  Kumar  refer  to  this  formulation  as  the  multi-objectie  graph 
partitioning  problem  in  [5].  In  this  paper,  we  present  a  new  formulation  for  the  multi-objective  graph 
partitioning  problem,  as  well  as  an  algorithm  for  computing  multi-objective  partitionings  with  respect  to 
this  formulation.  We  explain  how  this  scheme  is  able  to  be  tuned  by  a  user-supplied  preference  vector  in 
order  to  control  the  tradeoffs  among  the  different  objectives  in  the  computed  partitionings,  how  this  scheme 
results  in  predictable  partitionings  based  on  these  inputs,  and  how  this  scheme  is  able  to  handle  both  similar 
and  dissimilar  objectives.  We  show  that  this  multi-objective  graph  partitioner  is  better  able  to  balance 
the  tradeoffs  of  different  objectives  than  partitioning  with  respect  to  a  single  objective  only.  We  also  show 
that  by  modifying  the  input  preference  vector,  the  multi-objective  graph  partitioning  algorithm  is  able  to 
gracefully  tradeoff  decreases  in  one  objective  for  increases  in  the  others. 


2 


Partitioning 

1st  Objective 

2nd  Objective 

1st 

1.00 

100.0 

2nd 

1.01 

2.00 

3rd 

500.0 

1.00 

Table  1:  Example  edge-cut  results  of  three  two-objective  partitionings. 


2  Formulation  of  the  Multi-objective  Graph  Partitioning  Problem 

One  of  the  real  difficulties  in  performing  multi-objective  optimization  is  that  no  single  optimal  solution  exists. 
Instead,  an  optimal  solution  exists  for  each  objective  in  the  solution  space.  Furthermore,  finding  an  optimal 
solution  for  one  objective  may  require  accepting  a  poor  solution  for  the  other  objectives  [7].  The  result  is 
that  the  definition  of  a  good  solution  becomes  ambiguous.  This  being  the  case,  before  a  multi-objective 
graph  partitioning  algorithm  can  be  developed,  it  is  first  necessary  to  develop  a  formulation  that  allows  the 
user  to  disambiguate  the  definition  of  a  good  solution.  This  formulation  should  satisfy  the  following  criteria. 

(a)  It  should  allow  fine-tuned  control  of  the  tradeoffs  among  the  objectives.  That  is,  the  user  should  be 
able  to  precisely  control  the  amount  that  one  or  more  objectives  may  be  increased  in  order  to  decrease 
the  other  objectives  when  these  objectives  are  in  conflict  with  one  another. 

(b)  The  produced  partitionings  should  be  predictable  and  intuitive  based  on  the  user’s  inputs.  That  is,  the 
output  partitioning  should  correspond  to  the  user’s  notion  of  how  the  tradeoffs  should  interact  with 
each  other. 

(c)  The  formulation  should  be  able  to  handle  objectives  that  correspond  to  quantities  that  are  both  of 
similar  as  well  as  of  different  types.  Consider  the  example  of  minimizing  the  overall  communications  of  a 
multi-phase  computation.  Here,  all  of  the  objectives  represent  similar  quantities  (i.  e.,  communications 
overhead).  However,  other  applications  exist  whose  objectives  are  quite  dissimilar  in  nature.  The 
preconditioner  application  is  an  example.  Here,  both  the  number  and  the  magnitude  of  the  ignored 
non-zero  entries  are  to  be  minimized.  Minimizing  the  number  of  ignored  non-zeros  will  reduce  the 
communications  required  per  iteration  of  the  computation,  while  minimizing  the  magnitude  of  these 
entries  will  improve  its  convergence  rate.  These  are  quite  dissimilar  in  nature. 

Two  straightforward  means  of  disambiguating  the  definition  of  a  good  multi-objective  solution  are  (i)  to 
prioritize  the  objectives,  and  (ii)  to  combine  the  objectives  into  a  single  objective.  We  next  discuss  each  of 
these  in  the  context  of  the  above  formulation  criteria. 

Priority-based  Formulation.  The  definition  of  a  good  multi-objective  solution  is  ambiguous  when  the 
relationship  between  the  objectives  is  unclear.  One  of  the  most  straightforward  means  of  defining  this 
relationship  is  to  list  the  objectives  in  order  of  priority  [2,  9].  Therefore,  one  possible  formulation  of  the 
multi-objective  graph  partitioning  problem  is  to  allow  the  user  to  assign  a  priority  ranging  from  one  to  m  to 
each  of  the  objectives.  Now,  the  multi-objective  partitioning  problem  becomes  that  of  computing  a  k- way 
partitioning  such  that  it  simultaneously  optimizes  all  m  objectives,  giving  preference  to  the  objectives  with 
higher  priorities. 

This  formulation  is  able  to  handle  objectives  of  different  types  as  the  relationship  between  the  objectives 
is  well-described  and  the  objectives  are  handled  separately.  It  will  also  result  in  predictable  partitionings,  in 
that  the  highest  priority  objective  will  be  minimized  with  the  rest  of  the  objectives  minimized  to  the  amount 
possible  without  increasing  higher  priority  objectives.  However,  this  formulation  provides  the  user  with  only 
a  coarse-grain  control  of  the  tradeoffs  among  the  objectives.  For  example,  consider  a  two-objective  graph 
from  which  three  partitionings  are  computed.  The  first  has  an  edge-cut  vector  of  (1.0,100.0),  the  second 
has  an  edge-cut  vector  of  (1.01,2.0),  and  the  third  has  an  edge-cut  vector  of  (500.0,1.0).  (See  Table  1.) 
Typically,  the  second  of  these  would  be  preferred,  since  compared  to  the  first  partitioning,  a  1%  increase  in 
the  edge-cut  of  the  first  objective  will  result  in  a  98%  decrease  in  the  edge-cut  of  the  second  objective.  Also, 
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compared  to  the  third  partitioning,  a  100%  increase  in  the  second  objective  will  yield  a  99.8%  decrease  in 
the  first  objective.  However,  under  the  priority-based  formulation,  the  user  is  unable  to  supply  a  priority 
list  that  will  produce  the  second  partitioning.  This  is  because  partitionings  exists  with  better  edge-cuts  for 
each  of  the  two  objectives.  From  this  example,  we  see  that  the  priority-based  formulation  is  unable  to  allow 
the  user  fine-tuned  control  of  the  tradeoffs  between  the  objectives. 

Combination-based  Formulation.  While  prioritizing  the  objectives  describes  their  relationship  well 
enough  to  disambiguate  the  definition  of  a  good  solution,  it  is  not  powerful  enough  to  allow  the  user  fine- 
tuned  control  over  the  tradeoffs  among  the  objectives.  One  simple  approach  that  has  been  used  in  other 
domains  is  to  combine  the  multiple  objectives  into  a  single  objective  and  then  to  use  a  single  objective 
optimization  technique  [1,  6,  9].  In  the  context  of  multi-objective  graph  partitioning  this  is  done  as  follows. 
For  each  edge  e  a  scalar  weight  of 

m 

wC  =  ^ZwtPi-  (!) 

i=  1 

is  assigned  where  pi  is  a  preference  vector.  Then  a  single  objective  graph  partitioning  algorithm  is  used  to 
compute  a  partitioning  P  that  essentially  minimizes  C?:/h  where  (7;  is  the  edge-cut  with  respect  to  the 

1th  objective.  For  example,  if  we  have  a  three-objective  problem  and  want  to  give  the  second  objective  five 
times  the  weight  of  the  first  and  third  objectives,  we  could  use  a  preference  vector  of  (1,  5,  1).  An  edge  with 
a  weight  vector  of  say  (2,  2,  1),  would  then  be  assigned  a  combined  weight  of  2+10+1=13. 

Unlike  the  priority-based  formulation,  this  one  allows  a  fine-tuned  control  of  the  tradeoffs  among  the 
objectives,  since  the  objectives  are  weighted  and  not  merely  ordered.  However,  this  formulation  cannot 
handle  dissimilar  objectives.  This  is  because  it  requires  that  the  objectives  be  combined  (by  means  of  a 
weighted  sum).  For  dissimilar  objectives  (such  as  the  number  and  magnitude  of  the  ignored  elements  off  of 
the  diagonal),  this  combination  can  be  meaningless. 

One  possible  solution  is  to  divide  each  edge  weight  by  the  average  edge  weight  for  the  corresponding 
objective  in  an  attempt  to  normalize  all  of  the  objectives.  Normalization  may  help  us  to  combine  dissimilar 
objectives  in  a  more  meaningful  way.  However,  this  solution  fails  the  predictability  criteria.  Consider  the 
example  two-edge- weight  graph  depicted  in  Figure  1(a).  In  the  center  of  this  graph  is  a  clique  composed  of 
edges  with  edge  weight  vectors  of  (10000,  1),  while  the  rest  of  the  edges  have  vectors  of  (1,  1).  (Note,  not 
all  of  the  edges  have  their  weights  marked  in  the  figure.)  In  this  example,  the  first  edge  weight  represents 
the  degree  to  which  we  would  like  to  have  the  vertices  incident  on  an  edge  to  be  in  the  same  subdomain. 
The  second  edge  weight  represents  the  interaction  between  vertices  as  normal.  Therefore,  in  partitioning 
this  graph,  we  have  two  objectives,  (i)  We  would  like  the  vertices  of  the  clique  to  be  in  the  same  subdomain, 
(ii)  We  would  like  to  minimize  the  edge-cut.  The  intuitive  meaning  of  this  graph  is  that  the  clique  should  be 
split  up  only  if  doing  so  reduces  the  edge-cut  by  tens  of  thousands.  Figure  1(b)  gives  the  new  edge  weights 
after  normalization  by  the  average  edge  weight  of  each  objective.  Here  we  see  that  the  first  edge  weights  of 
the  clique  edges  have  been  scaled  down  to  about  five,  the  first  edge  weights  of  the  non-clique  edges  have  been 
scaled  down  to  about  zero,  and  the  second  edge  weights  of  all  edges  have  remained  at  one.  Now,  consider 
what  will  happen  if  we  input  different  preference  vectors  and  partition  the  graph.  If  the  preference  vector 
gives  each  objective  equal  weight  (i.e.,  a  preference  vector  of  (1,  1)),  then  the  clique  will  not  be  split  during 
partitioning.  This  is  as  expected,  since  the  clique  edges  in  the  input  graph  have  very  high  edge  weights 
for  the  first  objective.  Also,  if  we  favor  the  first  edge  weight  to  any  extent  (i.e.,  supply  a  preference  vector 
between  (2,  1)  and  (1000000,  1)),  this  trend  continues.  However,  if  we  favor  the  second  edge  weight  only 
moderately  (eg.,  a  preference  vector  of  (1,  6)),  then  the  optimal  partitioning  will  split  the  clique.  This  is 
because  normalizing  by  the  average  edge  weight  has  caused  the  first  edge  weights  of  the  clique  edges  to 
be  scaled  down  considerably  compared  to  the  second  edge  weights.  The  result  is  that  we  lose  the  intuitive 
meaning  that  the  first  edge  weights  had  in  Figure  1(a). 


3  A  Multi-objective  Graph  Partitioning  Algorithm 

As  discussed  in  the  previous  section,  existing  formulations  of  multi-objective  optimization  problems  do  not 
fully  address  the  requirements  of  the  multi-objective  graph  partitioning  problem.  In  this  section,  we  present 
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Figure  1:  This  is  an  example  of  a  two-edge-weight  graph.  The  edges  of  the  clique  in  the  center  of  the  graph  are  weighted 
(10000,  1)  in  (a)  and  (5.3,  1)  in  (b).  The  other  edges  are  weighted  (1,  1)  in  (a)  and  (.0005,  1)  in  (b).  The  edge  weights  in  (b) 
are  computed  by  normalizing  the  edge  weights  in  (a)  by  the  average  edge  weights  of  the  corresponding  objective. 


a  new  formulation  that  allows  the  user  to  control  the  tradeoffs  among  the  different  objectives,  produces 
predictable  partitionings,  and  can  handle  objectives  of  both  similar  as  well  as  dissimilar  type. 

Our  formulation  is  based  on  the  intuitive  notion  of  what  constitutes  a  good  multi-objective  solution. 
Quite  often,  a  natural  way  of  evaluating  the  quality  of  a  multi-objective  solution  is  to  look  at  how  close  it 
is  to  the  optimal  solutions  for  each  individual  objective.  For  example,  consider  a  graph  with  two  objectives, 
let  P}  .2  be  a  multi-objective  partitioning  for  this  graph,  and  let  C\  and  C2  be  the  edge-cuts  induced  by 
this  partitioning  for  the  first  and  second  objectives,  respectively.  Also,  let  P\  be  the  optimal  partitioning 
with  respect  to  only  the  first  objective,  and  let  C°  be  the  corresponding  edge-cut.  Finally,  let  P2  be  the 
optimal  partitioning  with  respect  to  only  the  second  objective,  and  let  C%  be  the  corresponding  edge-cut. 
Given  these  definitions,  we  can  easily  determine  whether  or  not  P]  j2  is  a  good  multi-objective  partitioning 
by  comparing  C\  against  C°  and  C2  against  C% .  In  particular,  if  C\  is  very  close  to  C°  and  C2  is  very  close 
to  C%,  then  the  multi-objective  partitioning  is  very  good.  In  general,  if  the  ratios  C\/C°  and  Cn/C^  are 
both  close  to  one,  then  the  solution  is  considered  to  be  good. 

Using  this  intuitive  notion  of  the  quality  of  a  multi-objective  partitioning,  we  can  define  a  scalar  combined 
edge-cut  metric,  Cc,  to  be  equal  to 


cc  =  E 


Cj_ 

C° 


(2) 


where  Ci  is  equal  to  the  actual  edge-cut  of  the  *th  objective,  and  C°  is  equal  to  the  optimal  edge-cut  of  the 
fth  objective.  We  can  augment  this  definition  with  the  inclusion  of  a  preference  vector  p.  So  Equation  2 
becomes 


°c  = 


i= 1 


(3) 


Equation  3  then  becomes  our  single  optimization  objective.  In  essence,  minimizing  this  metric  attempts 
to  compute  a  k- way  partitioning  such  that  the  edge-cuts  with  respect  to  each  objective  are  not  far  away  from 
the  optimal  edge-cuts.  The  distance  that  each  edge-cut  is  allowed  to  stray  from  the  optimal  is  determined 
by  the  preference  vector.  A  preference  vector  of  (1,  5)  for  example,  indicates  that  we  need  to  move  at  least 
five  units  closer  to  the  optimal  edge-cut  of  the  second  objective  for  each  one  unit  we  move  away  from  the 
optimal  edge-cut  of  the  first  objective.  Conversely,  we  can  move  one  unit  closer  to  the  optimal  edge-cut  of 
the  first  objective  if  it  moves  us  away  from  the  optimal  edge-cut  of  the  second  objective  by  less  than  five 
units.  In  this  way,  the  preference  vector  can  be  used  to  traverse  the  area  between  the  optimal  solutions 
points  of  each  objective.  This  results  in  predictable  partitionings  based  on  the  preference  vector  as  well  as 
fined-tuned  control  of  the  tradeoffs  among  the  objectives.  Finally,  this  scheme  works  with  both  similar  and 
dissimilar  objectives.  This  is  because  it  makes  all  quantities  similar  before  combining  them.  Each  element 
of  an  edge  weight  vector  is  divided  by  the  optimal  cut  of  its  corresponding  objective,  and  so,  represents  a 
certain  fraction  of  the  optimal  cut.  Since  all  weights  now  represent  a  fraction  of  the  optimal  cut,  they  can 
be  combined  meaningfully. 
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Figure  2:  This  shows  the  resulting  two-edge- weight  graph  constructed  by  normalizing  each  edge  weight  of  the  graph  in 
Figure  1(a)  by  the  optimal  edge-cut  for  the  corresponding  objective. 


If  we  further  expand  the  C,  term  of  Equation  3,  it  becomes 
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where  the  term  Ejecut  wi ’  represents  the  sum  of  the  *th  weights  of  the  edges  cut  by  the  partitioning, 
manipulating  this  equation,  we  get 
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The  term  El=i  V'c°  'n  Equation  5  gives  the  scalar  combined  weight  of  an  edge  (defined  in  Equation  1) 
with  each  weight  normalized  by  the  optimal  edge-cut  of  the  corresponding  objective.  Since  Equations  3 
and  5  are  equal,  we  have  shown  that  minimizing  the  normalized  combined  weights  of  the  edges  cut  by 
the  partitioning  minimizes  the  combined  edge-cut  metric,  Cc.  That  is,  the  problem  of  computing  a  A:- way 
partitioning  that  optimizes  Equation  3  is  identical  to  solving  a  single-objective  partitioning  problem  with 
this  proper  assignment  of  edge  weights. 

Consider  what  happens  if  we  apply  this  technique  to  the  problem  in  Figure  1  (a) .  Figure  2  gives  the  new 
edge  weights  after  the  edge  weights  from  the  graph  in  Figure  1(a)  are  normalized  by  the  optimal  edge-cut  of 
the  corresponding  objective.  Here,  we  see  that  the  first  edge  weights  of  the  clique  edges  are  still  quite  high 
compared  to  the  second  edge  weights.  Therefore,  we  must  favor  the  second  edge  weights  by  a  great  amount 
(eg.,  (1,  5000))  before  the  clique  is  split.  Here  we  see  how  our  scheme  obtains  more  predictable  results  than 
normalizing  by  the  average  edge  weights  of  an  objective. 

Note  that  this  formulation  can  also  be  described  under  the  fuzzy  logic  framework  [10].  Essentially,  we 
have  a  number  of  fuzzy  sets  equal  to  the  number  of  objectives.  Every  edge  has  some  degree  of  membership 
in  each  of  these  sets.  The  normalization  of  the  elements  of  the  edge  weight  vector  by  the  optimal  edge-cut 
performs  the  task  of  the  membership  functions.  Our  formulation  utilizes  a  preference  vector  as  the  ranking 
mechanism  between  sets.  Finally,  we  utilize  the  sum  of  the  (weighted  and  normalized)  edge  weight  values  as 
a  simple  fuzzy  combination  operator. 

We  have  developed  a  multi-objective  graph  partitioning  algorithm  that  is  able  to  compute  partitionings 
with  respect  to  this  new  formulation.  In  our  algorithm,  we  first  utilize  the  k- way  graph  partitioning  algorithm 
implemented  in  MTDS  [4]  to  compute  a  partitioning  for  each  of  the  m  objectives  separately.  We  record  the 
best  edge-cuts  obtained  for  each  objective.  Next,  our  scheme  assigns  to  each  edge  a  combined  weight  equal 
to  the  sum  of  the  edge  weight  vector  normalized  by  the  best  edge-cuts  and  weighted  by  the  preference  vector. 
In  the  final  step,  we  again  utilize  MFDS  to  compute  a  partitioning  with  respect  to  these  new  combined  edge 
weights. 


4  Ep  erimental  Results 

The  experiments  in  this  section  were  performed  using  the  graph,  MDUAL2.  It  is  a  dual  of  a  3D  finite 
element  mesh  and  has  988,605  vertices  and  1,947,069  edges.  We  used  this  graph  to  construct  two  types  of 
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(a) 


(b) 


(c) 


(d) 


Figure  3:  This  figure  compares  the  normalized  edge-cut  results  obtained  by  the  multi-objective  graph  partitioner  and  those 
obtained  by  partitioning  with  respect  to  each  of  the  objectives  alone  for  a  2-objective  Type  1  problem  (a),  a  2-objective  Type  2 
problem  (b),  a  4-objective  Type  1  problem  (c),  and  a  4-objective  Type  2  problem  (d). 


2-  and  4-objective  graphs.  For  the  first  type,  we  randomly  select  an  integer  between  one  and  100  for  each 
edge  weight  element.  For  the  second  type,  we  obtained  the  edge  weights  in  the  following  manner.  For  the 
first  objective,  we  computed  a  set  of  nine  different  7-way  partitionings  utilizing  the  k- way  graph  partitioning 
algorithm  in  MfBS  and  kept  a  record  of  all  of  the  edges  that  were  ever  cut  by  any  one  of  these  partitionings. 
Then,  we  set  the  first  edge  weight  element  of  each  edge  to  be  one  if  this  edge  had  ever  been  cut,  and 
five  otherwise.  Next,  we  computed  a  set  of  eight  different  11-way  partitionings  utilizing  the  k- way  graph 
partitioning  algorithm  in  MfflS  and  set  the  second  edge  weight  elements  to  one  if  the  edge  had  been  cut  by 
any  one  of  these  partitionings  and  15  otherwise.  For  the  4-objective  graphs  we  then  similarly  computed  a  set 
of  seven  different  13-way  partitionings  and  set  the  third  edge  weight  elements  to  either  one  or  45  depending 
on  whether  the  corresponding  edge  had  been  cut.  Finally  for  the  4-objective  graphs,  we  computed  a  set  of 
six  17- way  partitionings  and  similarly  set  the  fourth  edge  weight  elements  to  either  one  or  135. 

We  generated  the  Type  1  problems  to  evaluate  our  multi-objective  graph  partitioning  algorithm  on 
randomly  generated  problems.  We  generated  the  Type  2  problems  to  evaluate  our  algorithm  on  some 
particularly  difficult  problems.  Here,  every  graph  should  have  a  small  number  of  good  partitionings  for  each 
objective.  However,  our  strategy  of  basing  these  good  partitionings  on  7-,  11-,  13-,  and  17-way  partitionings 
was  designed  to  help  ensure  that  the  good  partitionings  of  each  objective  do  not  significantly  overlap. 
Therefore,  computing  a  single  partitioning  that  simultaneously  minimizes  each  of  these  objectives  is  difficult. 

Quantitative  Evaluation  of  the  Multi-objective  Graph  Partitioner.  Figure  3  compares  the  results 
obtained  by  the  multi-objective  graph  partitioner  with  those  obtained  by  partitioning  with  respect  to  each 
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(a) 


(b) 


(c) 


(d) 


Figure  4:  This  figure  gives  the  normalized  edge-cut  results  for  4-objective  64-way  partitionings  of  Type  1  problems.  The 
preference  vector  used  in  (a)  is  ( x ,  1,  1,  1),  (b)  is  (1,  x,  1,  1),  (c)  is  (1,  1,  x,  1),  and  (d)  is  (1,  1,  1,  x). 


of  the  objectives  alone  with  the  single  objective  graph  partitioner  implemented  in  M]3jS.  Specifically,  we 
show  the  results  of  2-  and  4-objective  64-way  partitionings  of  Type  1  and  2  problems.  In  Figure  3(a)  we 
give  the  results  of  partitioning  the  2-objective  Type  1  problem.  In  (b)  we  give  the  results  of  partitioning 
the  2-objective  Type  2  problem.  In  (c)  we  give  the  results  of  partitioning  the  4-objective  Type  1  problem. 
Finally,  in  (d)  we  give  the  results  of  partitioning  the  4-objective  Type  2  problem.  All  of  the  edge-cuts  are 
normalized  by  those  obtained  by  partitioning  with  respect  to  a  single  objective  only.  Therefore,  they  give 
an  indication  of  how  far  away  each  objective  is  from  the  optimal  edge-cut. 

Figure  3  shows  that  our  multi-objective  algorithm  is  able  to  compute  partitionings  such  that  a  good 
tradeoff  is  found  among  the  edge-cuts  of  all  of  the  objectives.  Partitioning  with  respect  to  a  single  objective 
obtains  good  edge-cut  results  for  only  a  single  objective.  All  of  the  other  objectives  are  worse  than  those 
obtained  by  the  multi-objective  algorithm. 

Control  of  the  Tradeoffs  by  the  Preference  Vector.  Figures  4  and  5  demonstrate  the  ability  of  our 
multi-objective  graph  partitioner  to  allow  fine-tuned  control  of  the  tradeoffs  of  the  objectives  given  a  user- 
suppled  preference  vector.  Specifically,  these  give  the  results  of  a  number  of  preference  vectors  for  4-objective 
64- way  partitionings  of  Type  1  and  2  problems.  Here,  three  of  the  four  elements  of  the  preference  vector  are 
set  to  one,  while  the  fourth  is  set  to  a  value  x.  This  value  is  plotted  on  the  x-coordinate.  The  //-coordinate 
gives  the  values  of  the  edge-cuts  of  each  of  the  four  objectives  obtained  by  our  multi-objective  algorithm. 
So,  as  we  move  in  the  direction  of  positive  infinity  on  the  x-axis,  a  single  objective  is  increasingly  favored. 
Figure  4  gives  the  results  obtained  on  Type  1  problems.  Figure  5  gives  the  results  obtained  on  Type  2 
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(c) 


(d) 


Figure  5:  This  figure  gives  the  normalized  edge-cut  results  for  4-objective  64-way  partitionings  of  Type  2  problems.  The 
preference  vector  used  in  (a)  is  ( x ,  1,  1,  1),  (b)  is  (1,  x,  1,  1),  (c)  is  (1,  1,  x,  1),  and  (d)  is  (1,  1,  1,  x). 


problems.  In  both  figures,  the  preference  vector  used  in  (a)  is  ( x ,  1,  1,  1),  (b)  is  (1,  x,  1,  1),  (c)  is  (1,  1,  x, 
1),  and  (d)  is  (1,  1,  1,  x).  All  of  the  edge-cuts  are  normalized  by  those  obtained  by  partitioning  with  respect 
to  a  single  objective  only. 

Figures  4  and  5  show  that  by  increasing  the  values  of  one  of  the  elements  of  the  preference  vector,  it 
is  possible  to  gracefully  tradeoff  one  objective  for  the  others  with  the  multi-objective  partitioner.  We  see 
that  in  each  result,  the  value  at  x  =  1  is  a  good  tradeoff  among  the  four  objectives.  As  x  is  increased,  the 
edge-cut  of  the  corresponding  objective  approaches  that  of  the  partitioning  with  respect  to  that  objective 
only.  The  edge-cuts  of  the  other  objectives  increase  gracefully. 

5  Conclusion 

We  have  described  a  new  formulation  for  the  multi-objective  graph  partitioning  problem  and  an  algorithm 
that  computes  multi-objective  partitionings  with  respect  to  this  formulation.  We  have  shown  that  this  algo¬ 
rithm  provides  the  user  with  a  fine-tuned  control  of  the  tradeoffs  among  the  objectives,  results  in  intuitively 
predictable  partitionings,  and  is  able  to  handle  both  similar  and  dissimilar  objectives.  We  have  shown  that 
this  algorithm  is  better  able  to  find  a  good  tradeoff  between  the  objectives  than  partitioning  with  respect  to 
a  single  objective  only.  Finally,  we  have  shown  that  by  modifying  the  preference  vector,  the  multi-objective 
graph  partitioning  algorithm  is  able  to  gracefully  tradeoff  decreases  in  one  objective  for  increases  in  the 
others. 

Parallelizing  the  multi-objective  graph  partitioning  algorithm  is  quite  trivial,  as  highly  scalable  imple- 
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mentations  of  parallel  graph  partitioners  exist  [3,  8].  These  codes  assume  that  the  graph  is  distributed  across 
the  processors.  They  return  the  edge-cut  results  to  each  of  the  processors.  Thus,  the  parallel  formulation 
consists  of  a  number  of  calls  to  a  parallel  graph  partitioning  routine  equal  to  the  number  of  objectives  followed 
by  a  phase  in  which  each  processor  independently  computes  its  vertices’  combined  edge  weights.  Finally, 
one  last  call  to  the  parallel  partitioner  utilizing  these  new  edge  weights  will  produce  the  multi-objective 
partitioning. 
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